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Abstract 

We  apply  Wijsman’s  theorem  for  the  ratio  of  den¬ 
sities  of  the  maximal  invariant  to  signal  detection  ap¬ 
plications.  The  method  does  not  recpiire  the  explicit 
we  of  a  maximal  invariant  statistic  or  its  density  to 
derive  the  uniformly  most  powerful  invariant  (UMPI) 
test.  We  describe  its  use  for  common  classes  of  detec¬ 
tion  problems  and  illustrate  its  use  in  examples.  The 
analytic  form  of  the  representation  provides  new  in¬ 
sight  into  the  relationship  between  the  UMPI  and  gen¬ 
eralized  likelihood  ratio  tests. 

1  Introduction 

1.1  Hypothesis  testing 

The  criterion  used  to  select  a  test  for  signal  detec¬ 
tion  applications  such  as  sonar  and  radar  is  typically 
the  test  that  provides  the  highest  probability  of  detec¬ 
tion  (Pd)  subject  to  a  given  probability  of  false  alarm 
(Pfa)  requirement.  The  detection  problem  is  cast 
as  a  hypothesis  test  in  which  the  null  hypothesis  is 
noise  and  the  alternate  hypothesis  is  signal  plus  noise. 
However,  use  of  the  Neyman-Pearson  lemma  to  derive 
tests  for  these  applications  usually  does  not  result  in 
a  test  that  can  be  implemented  due  to  unknown  sig¬ 
nal  or  noise  parameters.  A  uniformly  most  powerful 
(UMP)  test,  in  which  the  test  has  the  highest  Pd  over 
the  domain  of  unknown  parameters,  also  usually  does 
not  exist. 

When  the  UMP  test  does  not  exist,  various  ap¬ 
proaches  can  be  used  to  select  a  suboptimal  test.  One 
of  the  most  widely  used  is  the  generalized  likelihood 
ratio  test  (GLRT).  To  derive  the  GLRT,  the  un¬ 
known  parameters  under  each  hypothesis  are  replaced 
by  their  maximum  likelihood  estimates  (MLE’s)  [1], 
Among  the  known  properties  of  the  GLRT  in  invari¬ 
ant  problems  are  that  it  is  invariant  and  asymptoti¬ 
cally  UMPI.  However,  it  is  not  necessarily  UMPI  for 


finite  data  records,  even  when  the  UMPI  test  exists. 


1.2  Invariance 

The  principle  of  statistical  invariance  is  applied  to 
composite  hypothesis  testing  problems,  and  in  partic¬ 
ular  those  for  which  a  UMP  test  does  not  exist,  as 
an  approach  to  find  the  most  powerful  test,  among  the 
class  of  invariant  tests.  Using  the  criterion  that  the 
test  be  invariant,  as  a  further  requirement  of  a  satis¬ 
factory  test,  may  be  reasonable  for  the  problem  and 
lead  to  a  test  with  optimality  properties.  Even  if  the 
UMPI  test  is  found  not  to  exist,  then  the  derived  re¬ 
sult  can  be  used  as  a  performance  bound  for  the  class 
of  all  invariant  tests. 

Application  of  invariance  principles  to  hypothesis 
testing  is  described  in  statistics  texts  such  as  Lehmann 
[2].  The  text  of  Scharf  [3]  applies  invariance  methods 
to  signal  detection  applications.  The  classic  approach 
of  finding  the  UMPI  test  is  to:  identify  problem  in¬ 
variances,  describe  the  invariance  analytically  in  terms 
of  a  transformation  group,  choose  a  maximal  invari¬ 
ant  statistic,  derive  the  probability  density  function 
(PDF)  of  the  maximal  invariant  under  each  hypothe¬ 
sis,  and  then  construct  the  likelihood  ratio.  Another 
method  of  deriving  the  UMPI  test  statistic,  is  to  show 
that  a  scalar  maximal  invariant  has  a  monotone  like¬ 
lihood  ratio.  Scharf  and  Friedlander  [4]  use  that  ap¬ 
proach  to  show  that  the  GLRT  is  UMPI  for  classes  of 
detection  problems  that  fit  the  linear  model.  Here, 
we  use  Wijsman’s  theorem  for  the  likelihood  ratio  of 
maximal  invariant  densities,  which  does  not  require  a 
maximal  invariant  or  its  density.  We  note  that  the 
analytic  form  of  the  ratio  provides  insight  into  the  re¬ 
lationship  between  the  UMPI  and  suboptimal  tests. 
In  some  problems,  the  UMPI  test  statistic  can  be  in¬ 
terpreted  to  be  an  average  of  the  likelihood  ratio  over 
the  group  and  the  GLRT  statistic  the  maximum  of  the 
ratio  over  the  group. 
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1.3  Principal  literature 

Stein  [5]  is  credited  in  the  statistics  literature  for 
the  general  method  of  averaging  over  a  group  to  ob¬ 
tain  the  density  of  a  maximal  invariant  statistic.  He 
also  provided  an  expression  for  the  ratio  of  maximal 
invariant  densities.  Wijsman  [6]  further  developed  the 
approach  using  a  theory  of  cross  sections  of  orbits  and 
providing  conditions  under  which  the  ratio  is  valid. 
In  [7]  Wijsman  gives  alternate  conditions  which  can 
be  easier  to  apply  using  the  concept  of  proper  actions 
(Andersson  [8])  of  a  group.  Using  numerous  exam¬ 
ples,  he  also  shows  that  the  conditions  are  met  for  all 
the  “usual”  problems  arising  in  normal  multivariate 
analysis.  Eaton  [9]  provides  a  description  and  exam¬ 
ples  of  the  approach,  including  a  version  of  Wijsman’s 
theorem.  We  apply  these  results  to  the  groups  used 
in  signal  processing  applications,  show  that  the  ratio 
validity  conditions  are  met,  and  illustrate  its  use  for 
common  classes  of  signal  detection  problems. 

Applications  of  the  approach  to  obtain  the  density 
or  ratio  of  maximal  invariants  can  be  found  in  the 
statistics  literature  (e.g.,  in  Uthoff  [10]  and  Kariya  and 
Sinha  (ill).  The  only  use  of  the  approach  in  the  en¬ 
gineering  literature  known  by  us  is  Schwartz  [12].  He 
uses  invariance  principles  to  derive  CFAR  and  mini- 
max  detectors  for  a  signal  of  unknown  phase  in  Gaus¬ 
sian  noise  of  unknown  covariance.  To  obtain  the  ratio 
of  maximal  invariant  densities,  he  integrates  over  a 
group  (which  is  generated  by  the  composition  of  two 
groups).  The  integral  form  is  then  approximated  for 
the  low  SNR  case  to  obtain  a  CFAR  locally  minimax 
test. 

2  Representation  of  the  ratio  of 
maximal  invariant  densities 

To  derive  an  UMPI  test,  the  problem  invariances 
and  a  group  G  under  which  transformations  on  the 
data  should  leave  the  problem  invariant  are  identified. 
The  group  elements  are  denoted  as  g  6  G.  We  next 
use  Wijsman’s  theorem  to  derive  the  ratio  of  maximal 
invariant  densities.  In  particular,  we  use  the  approach 
as  described  in  Eaton  [9]  (theorems  5.8  and  5.9)  in 
which  the  ratio  is  given  by 

fpx  (gx;7fi)\'o(ff)  dui{g) 

fp*  (fix;  Ho)  Xo  ( 9 )  dui  ( g ) ' 

Lower  case  bold  notation  is  used  to  denote  vectors 
and  later,  upper  case  bold  will  be  used  to  denote 
matrices.  The  notation  gx  indicates  group  element 
transformations  on  the  data,  and  gO  is  the  notation 


used  to  denote  induced  group  actions  on  the  parame¬ 
ter  space.  To  interpret  this  ratio,  first  consider  that 
given  that  the  problem  is  invariant  under  the  transfor¬ 
mation  group  G,  then  densities  under  each  hypothesis 
must  satisfy  the  relationship  px  (g~1x;  0)  |  Jg - 1  (x)|  — 
px  (x:  gO).  The  Jacobian  \Jg- <  (x)|  is  the  usual  factor 
obtained  in  transformation  of  random  variables.  The 
factor  Xo  ( 9 )  of  Wijsman’s  ratio  is  the  inverse  of  this 
Jacobian,  |  Jg-\  (x)|  .  The  measure  ( g )  is  a  left 
invariant  measure  for  the  group.  For  signal  process¬ 
ing  applications,  this  measure  can  usually  be  written 
in  terms  of  a  Lebesgue  measure,  making  it  possible 
to  evaluate  the  resulting  integral  form.  For  cases  of 
discrete  groups,  the  integral  is  easily  converted  into  a 
summation.  See  Eaton  [9]  and  Kariya  [11]  for  other 
examples. 

2.1  Conditions 

Wijsman  [7]  describes  the  conditions  under  which 
the  ratio  is  valid  to  be  that  the  group  is  a  Lie  group, 
the  sample  space  is  a  subset  of  Euclidean  space,  and 
the  action  is  linear  or  affine.  He  states  that  these  are 
not  much  of  a  limitation  in  practice  since  all  known 
examples  seem  to  be  of  this  nature.  Additionally,  the 
group  action  must  be  proper,  and  under  the  assump¬ 
tion  of  locally  compact  groups  he  provides  a  lemma 
that  is  easy  to  apply.  Eaton  provides  a  version  of 
this  lemma  as  Theorem  5.6.  Wijsman  also  shows  how 
to  apply  his  lemma  to  groups  that  have  been  gener¬ 
ated  by  subgroups,  which  is  analogous  to  a  theorem 
in  Lehmann  (Chap  6,  Thm  2)  in  which  a  maximal  in¬ 
variant  is  generated  in  steps.  This  is  important  since 
we  are  now  working  with  groups  instead  of  maximal 
invariant  statistics. 

Appendix  I  provides  descriptions  and  examples  for 
the  lemma  terms  of  proper  action  and  locally  compact. 
A  summary  of  common  groups  and  those  relevant  to 
signal  processing  applications  is  also  provided.  AD  of 
the  groups  shown  meet  the  theorem  conditions.  In  us¬ 
ing  this  approach  to  derive  UMPI  tests,  we  work  with 
groups,  subgroups,  and  group  compositions,  instead  of 
with  maximal  invariant  statistics  and  their  densities. 

3  Signal  detection  examples 

Two  examples  are  provided  in  which  the  UMPI  test 
is  derived  and  compared  with  the  GLRT.  Insights 
gained  by  interpretation  of  the  analytic  form  of  the 
integral  are  provided. 

Example  1  Signal  Known  Except  for  Amplitude 
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The  hypothesis  test  is 


H0  :  x  =  w 
Hi  :  x  =  As  +  w, 


where  s  is  a  known  signal,  w  is  the  noise  vector  which 
is  distributed  as  N  (0,  (r2I) ,  and  A  (—00  <  A  <  00)  is 
an  unknown  scaling  factor  on  the  signal.  The  noise 
variance  a1  is  known.  Ho  and  Hi  denote  the  null 
and  alternate  hypotheses  respectively.  The  UMP  test 
for  this  problem  is  sgn  (.A)  sTx  >  7,  where  7  is  the 
threshold  established  by  the  Pfa  requirement.  Hence, 
for  the  UMP  test  to  exist,  we  need  to  know  sgn  (.4). 

Since  we  do  not  know  sgn  (4),  then  we  should  con¬ 
sider  tests  invariant  to  the  sign.  The  discrete  group 
G,  =  {gs  :  g.t  =  —1,1}  acts  on  the  data  samples  x 
under  the  operation  of  multiplication.  To  establish 
that  the  problem  is  invariant  [2],  it  is  shown  in  Ap¬ 
pendix  II  that  the  densities  belong  to  the  same  fam¬ 
ily  after  transformation,  and  the  parameter  spaces  are 
preserved. 

As  noted  in  section  II.B  and  in  Appendix  I,  this 
group  is  locally  compact  and  acts  properly  since  it 
is  discrete.  Hence  the  conditions  of  Wijsman’s  the¬ 
orem  are  met.  For  this  group,  Xo  (ffs)  =  1  since 
Px  (5sX;  ga9)  =  px  (x;  9).  A  counting  measure  is  a  left 
invariant  measure  and  used  since  the  group  is  discrete. 
Hence,  the  ratio  of  maximal  invariant  densities  is  given 

hv  ^HasLlLil  _  In  Px(9„x;Hi) 

JSdfl.XiWo)  2  2^g.={~  1,1}  px{x;«o)  ' 

since  px  (x;  Ho)  =  px  (— x;  Ho).  Expanding  the  ex¬ 
pression  gives 


E 

9*={-l.l} 


exp  (g„x  -  As)T  (ff.x  -  As)] 


=  -exp 


A2 

2a2 


T 

S 1  S 


exp  [- 

^exp  -^sTxj  +  exp  -^srx  ^  . 


The  expression  is  monotonic  with  respect  to  |sTx|, 
which  can  be  used  as  the  UMPI  test  statistic.  Observe 
that  the  above  expression  is  a  summation  over  a  two 
element  group  which  can  be  interpreted  as  an  average 
over  the  group.  The  GLRT  wall  be  seen  to  haw  an 
interpretation  of  the  maximum  over  the  group. 


The  GLRT  is  obtained  by  substituting  the  MLE  of 
A,  which  is  A  =  (srs)  1  sTx,  into  the  likelihood  ratio, 


Px 


(x;  As,  Hi) 


Px  (x;H0) 


This  is  also  monotonic  with  respect  to  |srx|,  and 
hence  the  GLRT  and  the  UMPI  tests  are  the  same. 


Next  consider  the  case  in  which  it  is  given  that 
A  >  0.  Here,  the  UMP  test  exists  and  is  sTx 
since  we  know  sgn  (A).  The  two  element  group 
G3  used  in  the  A  /  0  case  reduces  to  a  group 
with  a  single  element,  G  =  {1}.  This  trivial  case 
is  shown  for  illustration  of  the  concept,  and  will 
be  extended  later.  Using  this  group  in  the  ra¬ 
tio  gives  _  e*p[^(x-isp'(x-H  _ 

®  E '.,={!)  P*(sx;Hu)  exp(  vAxT*l 


exp  j^sTx  —  ^rSTsj ,  which  is  increasing  in  srx,  the 
UMPI  (and  UMP)  test  statistic.  However,  the  GLRT 
for  this  example  is  not  UMPI.  The  MLE  for  A  is 
A  —  max  ft),  (sTs)  1  sTx).  The  likelihood  ratio  is 


Px  (x;  As,  Hi) 

2^  (-2As7x  +  AVs) 

Px  (x;H0) 

f  exp  [0]  ,  for  A 

L  =  o 

exp  (sTs)  1  (sTx)2]  ,  for  A  >  0 


Taking  the  natural  log,  we  see  that  the  GLRT  can 
be  written  as  max(0,sTx).  This  test  has  a  lower 
probability  of  detection  (Pd)  than  the  UMPI  test  for 
probability  of  false  alarms  (Pfa)  in  the  interval  [.5, 1). 
Notice  that  in  the  GLRT  derivation,  the  parameter  A 
is  replaced.  The  UMPI  test  obtained  by  integrating 
oveT  the  sign  group,  induces  action  only  on  the  param¬ 
eter  sgn  (A)  and  not  A,  which  is  sgn  (A)  |A|.  In  re¬ 
placing  all  parameters,  the  GLRT  may  imply  a  larger 
group  invariance  than  indicated  by  the  problem  itself, 
and  can  result  in  a  suboptimal  test.  Eaton  ([9],  ex¬ 
ample  6.5)  provides  a  different  example  in  which  the 
GLRT  is  not  UMPI  and  also  attributes  the  result  to  a 
bit  “too  much  invariance,”  noting  that  fully  invariant 
procedures  such  as  the  likelihood  ratio  test  ( GLRT )  can 
be  improved  upon  by  simply  requiring  less  invariance. 

We  now  extend  the  example  beyond  the  trivial 
group  to  the  case  in  which  we  have  interference  of 
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unknown  level.  The  hypothesis  test  is 

Ho  :  x  —  dl  +  w 
Hi  :  x  —  dl  +  As  -f  w, 


where  the  noise  w  is  Gaussian  with  known  variance 
n‘2l.  and  the  1  denotes  an  N  x  1  vector  whose  el¬ 
ements  are  all  1.  It  is  also  given  that  A  >  0,  d 
is  unknown,  and  s  =  [  1  — 1  J  .  The  two  sam¬ 

ple  case  is  considered  for  simplicity.  The  density 
is  M  (dl,  under  Ho  ,  and  N  (dl+As,  <r2I)  un¬ 
der  Hi .  The  problem  is  invariant  under  the  transla¬ 
tion  group,  Gb  =  {Ob  :  pt,x  =  x  +  61,  he  R.1}.  The 
group  transformations  of  x  are  Gaussian,  with  means 
(61  +dl  and  61  + dl+As)  and  covariance  matrices  the 
same  as  before.  The  conditions  of  Wijsman’s  theo¬ 
rem  are  met  since  the  group  is  locally  compact  and 
acts  properly  (Appendix  I).  The  multiplier  \a  (.%) 
is  1  since  px  (psx;  §b0)  —  px  (x  +  61;  (d  -  6)  1+As)  — 
px  (x;  dl  I  As)  =  px  (x;  0).  That  is,  the  random  vari¬ 
able  transformation  by  the  group  elements  has  a  Ja¬ 
cobian  of  1.  For  the  left  invariant  measure  we  use 
Lebesgue  measure  db  since  subintervals  of  equal  length 
have  equal  measure  along  R1  (see  Appendix  III  for 
a  different  example).  TVansformation  by  translation 
group  elements  does  not  change  the  size  of  the  subin¬ 
terval  and  hence  the  measure  is  unchanged.  Further¬ 
more,  since  the  integrand  is  continuous,  the  Lebesgue 
integral  can  be  interpreted  as  a  Riemann  integral. 

px{x.+bl-,Hi)db 

Using  these  results,  the  ratio  is  p^x+bi.nu)db’ 
which  is 


/OO 

-coexP 


2^  (x  +  (6  -  d)  1  -  As)T 
•  (x  +  (6  —  d)  1  —  As) 

i  ^  (x  +  61)r  (x  +  61)  db 


db 


Poo  exp  [5^  (x  +  blf  (x  +  61)]  db 
and  simplified  further  to 

fZo  exP  (x  +  61  -  As)t  (x  +  61  -  As)]  db 
I-ooex p  ^(x  +  61)r(x  +  61)  db 


where  61  —  dl  has  been  replaced  with  61  since  the 
integration  is  over  the  interval  (—00,00).  The  As 
factor  can  be  brought  outside  the  integral  since  sTl  = 
0  and  it  is  not  a  function  of  6,  giving 


Aj 

poo 

J-  co^P 

Wi  (x  +  &1)T  (X  +  61) 

db 

a2 

r  00 

J-cc^P 

W  (x  +  blf  (x  +  61) 

db 

This  is  increasing  in  sTx,  since  A  >  0.  Hence, 
the  UMPI  test  statistic  is  srx.  Note  that  since 
s=[  1  —  1  ]  ,  the  statistic  sTx  —  x  [l]—ar  [2],  which 

is  invariant  to  the  interference. 

The  GLRT  is  obtained  by  substituting  A,  dQ,  and 
dj ,  the  MLEs  of  the  parameters  under  each  hypothesis 
into  The  MLE’s  are  A  =  max  (0.  isrx), 

and  do  =  d}  —  ^lTx.  Making  the  substitutions  and 
some  cancellations  gives  exp  J]^-  (srx)2]  for  the  A  > 

0  case,  and  0  for  the  A  =  0  case.  This  is  increasing  in 
max(0,  sTx) ,  which  can  be  used  as  the  GLRT  statistic. 

Hence,  this  is  an  example  for  which  the  UMPI  test 
exists,  but  is  not  given  by  the  GLRT.  As  noted  for  the 
two-sided  case,  in  deriving  the  GLRT  we  replaced  all 
unknown  parameters.  In  the  UMPI  derivation,  inte¬ 
gration  over  the  translation  group  implies  an  induced 
action  on  the  interference  parameter  only. 

Example  2  Signal  in  a  Known  Subspace 

This  example  is  of  the  form  of  the  classic  linear 
model 


Ho  ’■  x  =  w 
Hi  :  x  =  H0  +  w. 


The  N  x  p  matrix  H  is  known,  the  noise  w  is  Gaus¬ 
sian  with  known  variance  <r2,  and  the  pxl  parameter 
vector  6  is  unknown. 

We  use  the  pxl  sufficient  statistic  z  = 
(HTH)  2  H^x,  and  write  the  equivalent  hypothesis 
test  using  z  =  w  under  Ho,  and  z  -  (H^H)  2  9  + 
(HTH)  2  Hrw  under  H\.  Since  the  noise  term 
still  has  a  density  Ar  (0,<72I),  the  density  of  z  is 


Af^EfPH)2  9,  a2lj  under  Hi  and  A/”(0,<72l)  under 
Ho.  Note  that  we  use  this  version  of  the  suffi¬ 
cient  statistic  since  it  is  invariant  under  the  group 
G0  —  {g0  ’■  f!oz  =  Oz,  GtO  =  I}.  The  matrix  O  is 
the  p  x  p  orthogonal  group.  The  problem  is  shown  to 
be  invariant  in  Appendix  II.  Other  statistics  of  the 
data  and  different  groups  can  be  used  for  this  problem 
([3]  and  [4]).  The  statistic  and  group  used  rotates  the 
component  of  the  data  that  lies  in  the  signal  subspace 
and  leave  other  components  unchanged. 

The  p  —  2  case  is  now  developed.  Extension  to  the 
general  p  case  can  be  easily  made  using  generalized 
spherical  coordinates.  For  this  p  =  2  case,  the  orthog¬ 
onal  group  is  a  rotation  in  R1  and  can  be  written  as 


:  — 


COS  TJ 
sin  77 


—  SUIT/ 
cos  r? 


z,  Tje 


[— 7T,  7T]  , 
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which  is  a  set  of  2  x  2  matrices  that  act  under  multipli¬ 
cation  on  z.  Alternatively,  consider  the  group  G1  = 
{g-y :  g~/Z  ( r ,  a)  =  z  (r,  7  +  a)  ,  -ye  [ — tt,  jt]  },  which  is  a 
set  of  translation  elements  in  Rl  acting  under  mod¬ 
ulo  addition  on  the  angle  elements  (of  the  polar  form) 
of  z.  Define  z(r, a)  =  [  rcos7  rsin7  ]  .  Since 
it  can  be  shown  that  G0  and  G-,  are  isomorphic  (i.e., 
there  is  a  1-1  correspondence  between  elements  and 
also  between  the  results  of  computations),  we  can  use 
either  group  and  its  associated  action  on  the  data  to 
describe  the  problem  invariance.  This  is  a  translation 
group  and  hence  is  locally  compact  and  acts  properly 
(Appendix  I).  For  the  group  G-,,  the  left  invariant 
measure  dui  (p7)  is  the  Lebesgue  measure  dj  since  the 
composite  group  actions  are  translations  in  R 1  and 
Lebesgue  measure  for  an  interval  is  invariant  under 
translation.  The  group  multiplier  Xo  (&-,)  is  1. 

The  group  acts  on  the  angle  component  of  z  (r,  a). 
Under  7i\, 


Pz  (»*,  a) ;  (HrH) 2  9, a2 1) 

-  (2^j*  exp  [S  (z  <r'  “ + 7) '  (“rH)  1  e) 1 

•  (z  (r,o  +  7)  -  (HtH)  ^  . 


The  exponent 


2 rdT  (H^H)2 


simplifies 
cos  (a  +  7) 
sin  (a  +  7) 


to  ^(r2  - 

(H0)rH0).  Under 


Wo,  P*.  {g-y z  (r,  a) ;  0,<r2I)  =  - — 1— ^  exp  I  -  ^  I .  Us- 

ing  these  densities  in  the  ratio,  where  the  integration 
is  with  respect  to  Lebesgue  measure  and  since  the 
integrand  is  continuous  over  the  domain  of  integration 
we  have  the  ratio  of  Riemann  integrals,  giving 


Hi,  Pz  (g-)Z  (r,  a) ;  Hi)  d-/ 

Pz  (g-,*  {r,  a);na)d-y 

’h£M^{-2T6T(HTH)i 

+  (H0)TH0)]  dry. 

Denoting  the  1  x  2  matrix  91  (HTH) 2  in  its  polar 
form  by  [  rp  cos  j3  rp  sin  0  ]  and  dropping  the  non- 
data  dependent  term  gives 


cos  (a  +  7) 
sin  (a  +  7) 


sin/3 


cos  (a  +  7) 
sin  (a  +  7) 


_L  r 
~  27T  L 


exp 


rrp  , 
—7  cos  7' 


dl'  ~ Io  (  J  )  ’ 


where  "/  =  p  —  a  —  7,  and  I0  (^r)  is  a  modified  Bessel 
function  increasing  in  Hence,  the  UMPI  test 

statistic  is  r  (since  is  positive  and  not  a  function  of 
the  data),  which  in  terms  of  the  sufficient  statistic  is 
equivalent  to  zrz.  In  terms  of  the  original  data  sam¬ 
ples,  we  have  zTz  =  xTH  (HTH)  1  HTx.  Letting 
P*x  =  H  (HTH)_1  EFx,  which  is  the  projection  of 
x  onto  the  signal  subspace,  the  statistic  can  be  writ¬ 
ten  as  xrPffX  =  (Phx)tP„x.  The  test  statistic  can 
be  interpreted  as  the  energy  of  the  components  of  the 
signal  that  lie  in  the  signal  subspace.  This  statistic 
is  the  GLRT  for  the  linear  model.  Hence  the  GLRT 
is  UMPI.  Scharf  and  Friedlander  [4]  show  that  the 
GLRT  is  UMPI  for  classes  of  problems  which  include 
this  example. 


3.1  Relationship  between  tests 


The  integral  form  of  Wijsman’s  theorem  gives 
insight  on  the  relationship  between  the  GLRT 
and  UMPI  tests.  The  form  of  equation  1, 
S?„  [iyf  cos  7]  d-y,  can  be  viewed  as  an  ‘average 
over  the  group.’  Let  T(7)  =  cos 7  and  let  7  be 
the  value  of  7  €  [— 7r,  tt]  that  maximizes  T  (7).  Then, 


exp  [T  (7)1  d'y 


—  exp 

—  exp 


[T  (7)]  J  exp  [T  (7)  -  T  (7)]  dy 
R¥1  /_jr®T>[^(coS7-l)]d7. 


The  resulting  integral  is  an  increasing  function  of  T  (7) 
which  is  the  GLRT  for  this  problem.  This  inte¬ 
gral  form  suggests  the  additional  interpretation  that 
the  GLRT  is  UMPI  since  the  maximum  on  the  group 
(GLRT)  and  the  average  over  the  group  (UMPI)  are 
1-1. 

Use  of  this  analytic  form  to  investigate  the  relation¬ 
ship  between  tests  can  also  be  applied  to  problems  for 
which  the  integral  of  the  previous  equation  is  not  a  1-1 
function  of  the  maximum  on  the  group  factor.  The 
integral  factor  may  provide  insight  into  the  difference 
between  the  UMPI  and  maximum  on  the  group  statis¬ 
tics,  as  well  as  the  conditions  under  which  they  become 
equivalent  tests. 
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Appendix 
I  Groups 

For  the  lemma  described  in  Section  2.1,  the  group 
action  must  be  proper  and  it  is  assumed  that  the 
groups  are  locally  compact.  Consider  that  for  the 
case  of  RN ,  the  action  is  proper  if  for  any  closed 
and  bounded  subsets,  say  a  and  b,  the  set  of  all 
group  actions  such  that  {p  :  ga  fl  b  ^  </>}  is  closed  and 
bounded.  In  essence,  the  collection  of  group  ele¬ 
ments  that  transform  some  point  is  bounded.  As 
another  example  consider  the  scale  group  Gc  (defined 
below).  For  any  two  closed  and  bounded  subsets  of 
Rn,  there  exists  a  set  (c  :  ca  "1  b  (ft)  which  is  closed 
and  bounded. 

It  is  assumed  that  the  groups  are  locally  compact. 
Recall  that  a  space  in  RN  is  compact  if  and  only  if 
it  is  closed  and  bounded  (Heine-Borel  theorem).  A 
space  is  locally  compact  if  and  only  if  every  point  has 
at  least  one  compact  neighborhood.  As  an  exam¬ 
ple,  on  the  real  line  (which  is  not  compact  )  each  point 
p  is  interior  to  a  closed  interval  fp  —  6,p  +  <5],  which 
makes  it  locally  compact.  A  compact  space  is  auto¬ 
matically  locally  compact  and  every  discrete  space  is 
locally  compact  [13]. 

A  brief  description  of  groups  relevant  to  signal  de¬ 
tection  applications  that  meet  the  conditions  of  Wijs- 
man’s  theorem  follows. 

1.  Aln  —  {<m,6  :  9a, b*  —  Ax  +  b},  where  A  are  JV 
x  N  nonsingular  matrices  and  b  6  RN-  This 
is  known  as  the  affine  group.  This  group  is  not 
compact.  It  is  locally  compact  [9],  and  the  group 
action  is  proper  [7], 

2.  Gln  —  {gA  ■  pax  =  Ax},  where  A  are  N  x  N 
nonsingular  matrices.  This  is  the  general  linear 
group.  This  is  a  subgroup  of  the  affine  group. 
The  group  is  not  compact,  is  locally  compact  [9] 
and  acts  properly  [7). 

3.  Rn  —  {gb  ■  gb*  —  x  +  b,  b  e  RN}  is  a  subgroup 
of  Aln.  This  group  is  not  compact,  is  locally 
compact  [9],  and  acts  properly  [7].  A  subgroup 
of  this  is  the  translation  group,  where  b  —  61, 
which  is  locally  compact  and  acts  properly. 

4.  Gc  =  {pc  :  PcX  =  cx,  c  e  A!1\0}  is  the  scale 
group.  It  is  a  subgroup  of  Gln-  It  is  not  com¬ 
pact,  is  locally  compact.  Proper  action  is  inher¬ 
ited  from  Gln- 

5.  Gs  —  (ps  :  gsx  =  cx,  c  €  {— 1, 1}}  is  the  sign 
group.  It  is  a  subgroup  of  Gc-  It  is  discrete 


and  hence  is  compact,  locally  compact,  and  acts 
properly  since  discrete  groups  are  compact  and 
act  properly  [7]. 

6.  Ga  —  {p0  :  p0x  =  Ox,  Ot O  =  1}  is  the  orthogo¬ 
nal  group.  It  is  a  subgroup  of  Gln.  It  is  compact 
and  hence  is  locally  compact  and  acts  properly. 

7.  Pn  —  {gk  ■  PkX  —  P*z},  where  P*  are  the  N  x  N 
permutation  matrices.  These  contain  rows  and 
columns  with  exactly  one  element  equal  to  1  and 
the  others  are  0.  This  group  is  discrete  and  hence 
is  compact,  Locally  compact  and  acts  properly. 

II  Invariance  of  Examples 

In  example  1,  the  problem  is  invariant  under  Gs 
since  px  As)  |  Jg-<  (x)|  is 

i  r  i  n~x 

“  exP  H  (&lx  H  -  As  \n}f 

(27nr2)*  [  n=o 

1 

=  exP 

(2na2) 2  |_  n=0  J 

=  Px  (x;  gs  As) , 

since  =  g„.  The  Jacobian  |<7g-i  (x)|  of  the  trans¬ 
formation  is  1.  Hence,  transformation  of  x  by  these 
group  elements  results  in  a  random  variable  belonging 
to  the  same  family  of  densities,  with  a  different  value 
of  the  parameter  that  belongs  to  the  same  hypothesis. 

In  example  2,  the  problem  is  invariant  under  Ga 
since  under  Hi 

n-  (gpz;  IH'  H)1  j./3-  (z)j 

=  „p  [  s*  (°Tz  -  (hTh)’ 

[  ■  (oTz  -  (HrH)2  ft  ) 

(2tt<72)  »  [  -(z-O  (HtH)  2 

=  Pz  (z:go  (HrH) 2  . 

After  transformation,  the  PDF  belongs  to  the  same 
family  of  PDF’s  with  a  value  of  the  parameter  be¬ 
longing  to  the  same  hypothesis.  Similarly,  under  Hq, 
Pz  (g~li\0,cr2l)  |jg-i  (z)|  =p2  (z;  0,rr2I). 


761 


Ill  Multiplier  and  left  invariant 
measure  for  the  scale  group 

This  appendix  provides  an  additional  example  of 
both  the  invariant  measure  and  multiplier.  The  scale 
group  is  an  interesting  example  since  the  multiplier 
is  not  1  and  the  invariant  measure  is  not  simply  a 
counting  measure  or  the  measure  of  an  interval. 

Consider  the  transformation  y  =  gcx  =  cx,  c  ^  0. 
Assuming  Gaussian  densities  with  unknown  mean  pi 
and  variance  a2 1.  the  multiplier  can  be  obtained  from 
the  following  PDF  relationship, 


Px  (9C  ill,  <r2l)  |./9-i  (x)  | 


(2ttc2ct2) 


exp[2^(x-CMl)7’(x"^1) 


Hence  (see  Section  II,  Jacobian  and  multiplier  discus¬ 
sion)  the  multiplier  is  xo  (5<0  =  (x)j  =  cjjV. 

A  left  invariant  measure  for  scale  group  is  described 
next.  Consider  that  for  this  group,  the  composi¬ 
tion  of  two  group  elements  is  gcgcix  =  5cc,x  =  ccix, 
and  this  composite  action  occurs  in  Rl.  An  invari¬ 
ant  measure  in  R1  with  A  =  [ai,a2]  C  Rl  should 
satisfy  iq  ( gcA i)  —  iq  (A).  Note  that  the  Lebesgue 
measure  JA  dx  —  02  -01  ^  fcA  dx  is  not  invariant. 
We  need  an  invariant  measure,  tq  ( cA )  —  iq  (A)  Vc  7^ 
0.  For  iq  absolutely  continuous  with  respect  to  a 
Lebesgue  measure,  then  by  the  Radon-Nikodym  the¬ 
orem,  in  (A)  =  JAg  (x)  dx,  where  g  (x)  is  a  unique 
nonnegative  measurable  function.  Hence,  for  iq  (A) 
to  be  invariant,  it  must  equal  tq  (cA)  =  fc4g(x)dx. 
Let  u  —  | .  Then  iq  (cA)  =  fA  g  (cu)  |c|  du  =  iq  (A). 
This  implies  that  we  need  g  (cu)  |c|  —  g  («).  A  solu¬ 
tion  is  g  (u)  —  where  we  define  g  (0)  =  0.  Hence, 
*W  =  !a  |kjdu  which  in  the  notation  of  Wijsman’s 
theorem  is  =  j^y,  or  du,  (c)  =  -^dc. 

For  the  problem  of  detection  of  a  known  signal  of 
unknown  level  in  white  Gaussian  noise  of  unknown 


variance,  the  substitutions  into  the  theorem  gives 
/  p,,(^.?0  )|c|  _i<te  js  easiiy  simplified  into  the 


J  Pxlcxi-Hollcl' 

test  statistic 
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